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1.0  SUMMARY 

A  software  framework  called  Digital  Representation  Environment  for  Analysis  of 
Microstructure  (DREAM3D)  has  been  created  that  allows  a  user  to  reconstruct  three- 
dimensional  materials  data  into  a  voxel  representation  where  further  statistical  analysis  can  be 
applied  to  the  data  resulting  in  new  insights  into  the  internal  structure  of  a  material.  In  addition 
to  the  new  software  framework  can  generate  synthetic  microstructurcs  that  mimic  a  range  of 
important  material  groups  to  the  Air  Force  including  poly-crystal  metals,  ceramics  and 
composites.  These  synthetic  structures  can  be  used  in  microstructurc  simulations  involving 
Finite  Element  Method  algorithms,  data  acquisition  sensitivity  studies  and  linking  material 
properties  to  material  structure.  The  software  is  simple  and  easy  to  use  due  to  its  Graphical  User 
Interface  and  allows  the  user  to  easily  share  their  analysis  with  others  using  DRJ.AM3D  through 
a  common  file  format.  The  software  framework  utilizes  the  UDF5  file  format  to  store  all  input 
and  processed  data.  HDF5  is  an  open-source  file  format  that  is  designed  for  high  performance 
and  full  data  description  so  that  every  HDF5  file  has  a  full  description  of  the  data  stored  in  the 
lile  itself  and  can  be  queried  as  needed.  Finally  the  DREAM3D  software  itself  is  open-source 
and  anyone  can  download,  use  and  extend  DREAM3D  by  visiting  the  home  website  at 
dream3d.bluequartz.net. 
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2.0  INTRODUCTION 


In  the  last  four  years  there  has  been  a  large  push  in  the  materials  science  community  to  utilize 
computational  materials  science  in  more  and  more  areas.  This  push  is  referred  to  ICME  or 
Integrated  Computational  Materials  Science  and  this  paradigm  shift  is  starting  to  take  hold  in  the 
various  laboratories  worldwide.  But  with  every  newr  shift  comes  issues  that  the  originators  had 
never  considered  and  one  that  stands  out  is  the  “Integrated”  in  ICME.  From  the  originators  of 
ICME’s  ideas  was  that  all  the  computational  codes  could  communicate  between  each  other  easily 
and  thus  the  "Integrated"  would  be  satisfied.  Unfortunately  in  the  research  world  new  computer 
codes  rarely  are  able  to  communicate  with  other  codes  due  to  differences  in  input  and  output  file 
formats,  computer  architectures  or  communications  protocols.  Codes  that  are  initially  created 
during  a  single  research  grant  period  such  as  a  contract  or  a  PhD  dissertation  typically  are  a 
“proof-of-concept”  code  base  that  can  only  read  a  single  set  of  inputs  and  are  not  designed  with 
robustness  or  flexibility  in  mind.  To  make  matters  even  worse  the  documentation  is  lacking  and 
the  human-computer  interface  is  substandard  at  best.  All  of  these  combine  to  ensure  that  the 
codes  are  never  able  to  be  used  easily  by  other  researchers  who  may  in  fact  be  interested  in  the 
algorithms  being  used.  What  is  needed  is  a  software  framework  that  acts  as  an  umbrella  that 
allows  all  of  these  disparate  codes  to  communicate  seamlessly  w  ith  each  other  so  that  new  any 
new  algorithms  can  build  upon  algorithms  that  have  been  proven  in  both  research  and 
commercial  settings.  This  same  software  umbrella  framew'ork  would  allow  the  various 
algorithms  to  be  combined  into  series  of  operations  collectively  referred  to  as  a  pipeline  where 
the  operations  are  know  as  filters  and  each  filter  is  aware  of  a  common  data  structure  and  can 
thus  communicate,  or  talk,  to  the  other  algorithms.  The  new  software  framework  would  be 
easily  accessible  to  any  researcher  who  wanted  to  simply  use  the  algorithms  for  their  own 
research  or  add  to  the  software  framework  new  algorithms  that  they  want  to  share  with  the  rest  of 
the  community.  To  this  end  the  current  contract's  answer  to  this  problem  is  the  DREAM3D 
software  environment. 
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3.0  METHODS,  ASSUMPTIONS,  AM)  PROCEDURES 
3.1  DREAM31) 


DREAM3D  stands  for  the  Digital  Representation  Environment  for  Analysis  of  Microstructure  in 
3D  and  is  the  culmination  of  3  years  of  development  work  to  integrate  a  wide  range  of  individual 
software  tools  into  a  single  cohesive  software  package  that  is  usable  by  the  every-day  materials 
scientist.  DREAM3I)'s  main  capabilities  are  the  reconstruction  of  EBSD  (Electron  BackScatter 
Diffraction)  data  into  a  3  dimensional  representation  that  can  simply  be  visualized  for  a  greater 
understanding  of  the  material  or  analyzed  with  a  range  of  statistical  methods  to  quantify  the 
microstructure  in  order  to  link  material  properties  to  a  specific  type  of  microstructure.  Another 
capability  of  DREAM3D  is  to  generate  a  purely  synthetic  microstructure  based  on  statistics. 
Those  statistics  can  either  be  derived  from  real  data  or  created  through  an  ancillary  program 
called  “StatsGenerator.”  Once  these  3D  structures,  or  models,  arc  created  using  DREAM3D 
the  user  can  now  export  the  model  into  a  data  format  suitable  for  use  in  any  number  of  Finite 
Element  Methods  (FEM)  simulations  for  such  things  as  shocked  materials,  simulated  heat  stress 
experiments  or  simple  mechanical  loading  simulations.  Each  type  of  analysis  gives  the  materials 
scientist  a  deeper  understanding  of  the  link  between  a  material's  properties  and  its 
microstructure. 

3.2  Software  Development  Practices 

During  the  development  of  DREAM3D  best  practices  for  computer  software  development  were 
employed  where  possible.  These  best  practices  are  industry  standard  ideas  that  have  been 
developed  and  refined  over  the  last  20  years  in  the  software  engineering  domain.  Practices  such 
as  having  a  central  location  to  store  the  source  codes,  a  system  to  control  and  track  each  revision 
to  the  software,  creating  small  targeted  programs  called  “Unit  Tests"  that  allow  changes  to  the 
software  to  be  checked  against  known  standards  and  using  accepted  documentation  practices 
were  all  used  during  the  development  of  DREAM3D.  Once  a  stable  version  of  DREAM3D  has 
occurred  precompiled  binaries  for  Microsoft  Windows,  Apple  OS  X  and  Linux  were  posted  to 
the  DREAM3D  website  located  at  http://dream3d.hluequartz.net  and  hosted  by  the  contractor.  In 
addition  a  collection  of  interested  users  was  collected  and  these  users  were  sent  brief  messages 
informing  them  of  the  new  release. 

3.2.1  Source  Code  Repository 

During  the  development  of  computer  software  w  here  multiple  programmers  are  involved  tools 
that  allow  each  engineer  to  rapidly  make  changes  to  the  project  are  invaluable.  For  this  reason  a 
source  code  repository  was  created  where  each  programmer  can  both  get  the  latest  versions  of 
the  source  code  files  and  deposit  their  own  changes.  The  particular  protocol  decided  upon  by  the 
DREAM3d  team  was  "Git"  as  it  has  a  good  balance  of  ease  of  use,  cross  platform  use  and 
powerful  tracking  abilities.  Programmers  were  encouraged  to  “push”  their  code  to  the  repository 
where  it  is  “merged”  with  everyone  else's  changes.  When  the  programmer  needs  an  up-to-date 
version  they  can  simply  "pull"  the  changes  from  the  central  Internet  based  server  onto  their  local 
workstations.  This  workflow  where  one  pulls,  merges  and  then  pushes  is  a  standardized 
workflow  in  today's  software  engineering  domain  and  enables  those  writing  software  tools  to 
easily  collaborate  with  other  programmers  around  the  world.  In  order  to  make  the  software 
codes  developed  under  this  contract  easily  accessible  a  server  was  provisioned  that  serves  as  a 
central  location  to  store  the  source  code  repository.  Registered  developers  can  access  the 
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repositories  for  reading  and  writing  through  the  Secure  Shell  (SSH)  protocol.  The  source  code 
repository  is  in  this  respect  ‘private’  to  just  the  DRKAM3D  developers  and  anyone  else  that 
meets  the  proper  criteria  and  has  asked  for  access  to  the  repository. 

3.2.2  External  Libraries  Needed  for  DREAM3D 

In  the  spirit  of  reusing  codes  that  are  already  in  existence  and  to  speed  the  development  cycle. 
DRHAM3D  leverages  several  open  source  libraries  that  contain  reusable  components  that  allow 
DRTAM3D  to  be  deployed  on  all  the  industry  standard  desktop  class  operating  systems  and  also 
allow  a  more  rapid  development  and  revision  cycle. 

3.2.3  CMake 

CMake  is  used  to  describe  how  the  various  software  components  are  compiled  together  and  is 
able  to  generate  configuration  files  for  a  large  number  of  popular  development  environments 
including  Visual  Studio  for  Microsoft  Windows.  Xcode  for  Apple’s  OS  X  and  Makefiles  for 
typical  Linux  installations. 

3.2.4  Boost 

Boost  is  an  open-source  software  library  that  has  many  reusable  C++  components.  In  this 
instance  we  are  using  Boost  for  low-level  C++  object  memory  management  and  error  detection. 

3.2.5  Intel  Threading  Building  Blocks  (TBB) 

TBB  is  used  by  software  developers  to  create  versions  of  their  codes  that  can  be  executed  in 
parallel  on  multiple  CPUs  or  CPU  cores.  The  TBB  library  is  open-source  and  is  mainly  backed 
by  the  Intel  Corporation  and  is  quickly  becoming  a  standard  in  the  software-programming 
domain. 

3.2.6  Qt 

The  Qt  software  framework  is  an  open-source  software  development  framework  that  has 
successfully  abstracted  the  need  to  write  platform  specific  software  code.  This  allows  a  single 
developer  to  target  the  three  main  operating  systems  in  use  today  without  any  major  code 
changes  for  each  platform. 

3.2.7  Qwt 

Qwt  is  a  2D  plotting  software  library  that  uses  the  Qt  framework  as  its  drawing  canvas  making 
the  use  of  Qwt  a  natural  fit  for  applications  that  present  a  GUI  created  with  the  Qt  softw  are 
framework. 

3.2.8  Eigen 

Ligen  is  a  Matrix  and  Array  manipulation  and  linear  algebra  software  package.  Because  the 
code  is  based  on  C++  structures  and  not  the  typical  FORTRAN  language  this  allows  Eigen  to  be 
more  easily  used  on  cross  platform  projects. 

3.2.9  DOxygen 

Doxygen  is  used  to  document  source  code  by  enumerating  code  comments  w  ith  special  markers 
that  the  Doxygen  parser  can  find  easily.  The  programmer  has  the  ability  to  select  what  types  of 
output  to  be  produced  from  LaTeX.  H  TML  or  Rich  Text  Format  (RTF).  Doxygen  was  used  to 
document  as  much  of  the  source  and  filters  as  possible. 
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3.2.10  System  Requirements 

All  the  applications  developed  under  this  contract  work  on  the  vast  majority  of  desktop 
computers  including  computers  designated  as  "Workstations.”  The  limiting  factor  for  running 
the  application  is  that  the  computer  has  enough  memory  available  to  process  the  input  data. 


Table  1.  General  System  Requirements 


Operating  System 

Apple  OS  X 

OS  X  versions  10.6.8.  64  Bit.  Intel  Arch 

Microsoft  Windows 

XP(sp3).  Vista.  7.  8.  32/64  Bit.  Intel  Arch 

Linux 

Red  Hat  Linux  Version  6.  64  Bit.  Intel  Arch 
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4.0  RESULTS  AND  DISCUSSIONS 

In  the  current  incarnation  DRF.AM3D  focuses  on  the  processing  of  orientation  data  collected 
from  various  manufacturers  instruments  and  generation  of  synthetic  microstructures.  This  locus 
was  a  design  decision  so  that  the  programmers  could  concentrate  on  creating  solid  algorithms  for 
processing  data  instead  of  trying  to  reinvent  a  3D  viewer.  For  visualization  duties  the  user  is 
encouraged  to  utilize  the  free  ParaView  software  available  from  http://www.paraview.org.  At 
current  count  there  are  approximately  1 IX  processing  filters  that  are  included  in  DRLAM3D  that 
gives  the  user  a  wide  range  of  processing  choices  and  fall  into  the  following  general  categories. 

•  Reconstruction  of  Orientation  Data 

•  Calculating  Statistics  on  the  reconstructed  structure 

•  Generating  a  synthetic  microstructure 

•  Generating  a  surface  mesh  suitable  for  use  in  simulation  codes 

4.1  Data  Representation 

DRHAM3D  uses  a  data  structure  that  is  based  on  the  concepts  of  combinatorial  topology  and 
common  methods  for  describing  mesh  structures.  Any  topological  network  (in  2-  or  3-D)  can  be 
described  with  a  the  following  hierarchy: 

If  the  mesh  (or  network)  is  2-D.  then  the  volume  element  does  not  exist  and  the  face  element  is 
the  highest-level  element,  l  or  typical  voxel-based  data,  the  voxels  are  the  Volume  elements  and 
are  referred  to  within  DRFAM3D  as  cells.  Similarly,  in  a  surface  mesh  with  triangular  patches, 
the  triangles  are  the  face  elements  and  arc  referred  to  within  DRHAM3D  as  faces.  This  topology 
is  required  to  describe  the  “mesh”  or  “structure"  of  the  data  itself  and  is  not/cannot  be 
adjusted/defined  by  the  user. 

However,  once  the  topology  of  the  "structure"  is  set.  the  user  can  begin  grouping  topological 
elements  into  higher-level  features  of  the  “structure."  Below  is  an  example  of  this  grouping  for  a 
voxel-based  dataset  of  a  polycrystallinc  metal. 
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Figure  !.  DREAM3D  Hierarchy  of  Topology 


DREAM3D  uses  two  additional  levels  above  the  topological  levels  required  to  define  the 
"structure"  of  the  data.  These  two  levels  are  called:  field  and  ensemble.  These  levels  allow  the 
user  to  group  topological  elements  together  based  on  criteria  of  similarity.  For  the  example 
above,  the  cells  arc  grouped  to  identify  fields  (i.e.  grains)  by  applying  a  criterion  of  similar 
crystallographic  orientation  (i.e.  neighboring  cells  with  similar  orientation  are  said  to  belong  to 
the  same  field).  The  fields  arc  then  grouped  to  identify  ensembles  by  a  criterion  of  similar  phase 
(i.e.  all  grains  of  the  same  phase  in  the  dataset  are  said  to  belong  to  the  same  ensemble).  The 
grouping  criteria  are  at  the  discretion  of  the  user,  because  these  additional  levels  are  not  required 
for  description  of  the  "structure."  but  rather  are  organizational  levels  for  describing  the 
information  that  lives  on  the  “structure.” 

At  each  level,  DREAM3D  creates  a  map  to  store  information/data  about  the  individual  elements 
at  that  level.  Additional  information  about  the  maps  of  the  DREAM3D  data  structure  and 
"typical"  data  are  given  below: 
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Is 

(100s -1.000s  of  Fields) 

Figure  2.  DREAM3D  Internal  Data  Structures  and  Organization 


4.1.1  Vertex 

-  Map  of  attributes  associated  with  single  points. 

-  Measured  values  (i.e.  Orientation,  Chemistry,  Gray  scale,  etc.)  -  generally  measured  data  is 
not  represented  at  the  vertex  level,  but  the  user  could  choose  to  store  measured  values  at  the 
vertices  rather  than  the  more  typical  cell-centered  convention. 

-  Calculated  values  (i.e.  Curvatures,  Coordination,  etc.)  -  these  calculated  values  are  typically 
values  associated  with  the  connectivity  or  geometry  of  the  “mesh"  or  “structure"  itself. 

4.1.2  Edge 

-  Map  of  attributes  associated  w  ith  edges  of  faces. 

-  Measured  values  -  data  is  not  typically  measured  at  the  edge  level. 

-  Calculated  values  (i.e.  Curvatures.  Coordination,  etc.)  -  these  calculated  values  are  typically 
values  associated  with  the  connectivity  or  geometry’  of  the  “mesh”  or  “structure"  itself. 

4.1.3  Face 

-  Map  of  attributes  associated  w  ith  surface  patches. 

-  Measured  values  -  data  is  not  typically  measured  at  the  face  level. 

-  Calculated  values  (i.e.  Bounding  Field  Ids.  Normals.  Curvature,  etc.)  -  these  calculated  values 
are  typically  IDs  to  the  higher  level  maps  (field  and  ensemble),  related  to  gradients  of  the 
measured  values,  values  associated  w  ith  the  connectivity  or  geometry  of  the  “mesh"  or 
“structure"  itself  or  relationships  to  values  calculated  in  the  higher  level  maps. 
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4.1.4  Cell 


-  Map  of  attributes  associated  with  single  data  points  -  often  these  data  points  are  not  truly 
volumes,  but  rather  point-probe  measurements  that  are  homogenized  over  the  volume  nearest 
to  each  probe-point. 

-  Measured  values  (i.e.  Orientation.  Chemistry.  Gray  scale,  etc.)  -  typically  this  is  the  level  at 
which  most  data  is  actually  acquired. 

-  Calculated  values  (i.e.  Field  Ids.  Kernel  Avg.  Misorientation.  Euclidean  Distance,  etc.)  -  these 
calculated  values  are  typically  IDs  to  the  higher  level  maps  (field  and  ensemble),  related  to 
gradients  of  the  measured  values  or  relationships  to  values  calculated  in  the  higher  level  maps. 

4.1.5  Field 

-  Map  of  attributes  associated  with  sets  of  data  points  -  generally  elements  in  this  map  are  sets 
of  contiguous  cells  that  have  some  aspect  of  similarity,  often  in  their  measured  values  (i.e. 
orientation,  chemistry,  gray  scale,  etc.). 

-  Measured  values  (i.e.  Avg.  Stresses.  Avg.  Strains,  etc.)  -  some  measurement  techniques  are 
capable  of  measuring  values  averaged  over  an  entire  field  (i.e.  High  Energy  Diffraction 
Microscopy). 

-  Calculated  values  (i.e.  Avg.  Orientation.  Size,  Shape.  No.  Of  Neighbors,  etc.)  -  Generally 
there  is  little  measured  data  at  this  level  and  these  values  are  calculated  from  averaging  the 
measured  data  from  the  cells  that  constitute  each  field  or  geometrically  describing  the  size 
and/or  shape  of  the  set  of  cells. 

4.1.6  Ensemble 

-  Map  of  attributes  associated  with  sets  of  fields. 

-  Measured/Set  values  (i.e.  Crystal  Structure,  Phase  Type,  etc.)  -  measured  values  at  the 
ensemble  level  are  usually  user-defined  parameters  during  the  data  collection  or  during 
analysis  within  DREAM  3D. 

-  Calculated  values  (i.e.  Size  Distribution,  No.  Of  Fields,  ODF.  etc.)  -  These  values  are  typically 
descriptions  of  the  distribution  of  values  from  the  lower  level  field  map. 

4.2  DREAM3D  Data  Outputs 

DREAM3D  is  capable  of  creating  files  for  many  different  uses  including  analysis,  visualization 
and  archiving.  During  any  DRF.AM3D  session  the  user  can  select  to  save  their  processed  data  to 
an  HDF5  based  file  format  that  will  store  all  data  that  is  currently  resident  in  memory.  IIDF5 
was  built  for  extremely  large  data  sets  to  archive  data  generated  on  High  Performance 
Computing  (HPC)  systems.  HDF5  is  open-source  ensuring  that  data  generated  is  always 
available  to  the  user.  If  the  user  wishes  to  plot  various  statistics  DREAM3D  can  output 
compatible  tabular  types  of  files  that  modern  statistical  analysis  and  plotting  packages  are 
capable  of  reading.  And  finally  if  the  user  wishes  to  visualize  the  original  and/or  processed  data 
DREAM3D  can  create  files  for  products  such  as  the  free  ParaView  or  the  commercial  Avizo  Fire 
data  visualization  programs. 
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4.3  Extending  DREAM3D 

As  more  features  have  been  added  to  DREAM3D  experts  in  the  domain  of  31)  materials  seienec 
have  started  diseussions  regarding  how  to  integrate  their  own  computer  codes  into  DREAM3D. 
Being  conscious  that  not  every  organization  is  in  a  position  to  release  their  intellectual  property, 
a  novel  plugin  system  has  also  been  incorporated  into  DREAM3D  that  would  allow  an 
organization  to  build  on  the  core  of  DREAM3I)  w  ith  their  own  proprietary  software  models, 
simulations  and  filters.  For  those  scientists  that  have  the  necessary  programming  skills 
DREAM3D  can  be  extended  through  the  direct  addition  of  filters  into  the  core  of  DREAM3D  or 
by  creating  their  ow  n  collection  of  filters  that  arc  grouped  into  an  extra  library  called  a  plugin. 
These  options  can  cover  a  wide  range  of  possibilities  for  organizations  wanting  to  extend 
DREAM3D  and  due  to  the  use  of  a  non-viral  open-source  license  for  DREAM3D  this  is  entirely 
possible.  The  follow  ing  are  just  two  possible  scenarios  that  the  plugin  system  creates. 

4.3.1  Proprietary  Algorithms 

One  possible  scenario  is  that  a  group  would  like  to  leverage  DREAM3D  for  its  base  set  of  filters 
but  add  their  own  processing  algorithms  into  DREAM3D  but  not  have  to  release  either  the 
source  code  for  the  algorithms  or  the  actual  binary  plugin  itself.  By  using  DREAM3D's  plugin 
system  this  is  entirely  possible  as  the  group  can  gain  access  to  the  complete  source  code  for 
DRLAM3I)  and  compile  and  distribute  within  their  organization  their  own  custom  version  of 
DREAM3D. 

4.3.2  Monetizing  DREAM3D 

Another  scenario  for  extending  DREAM3D  would  see  custom  processing  filters  being  created  as 
plugins  for  DREAM3D  and  sold  through  various  means  to  those  organizations  needing  the 
seller's  algorithms. 
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5.0  CONCLUSIONS 


Over  the  last  few  years  as  DREAM3D  matured  into  an  easily  usable  application.  It  has  gained  a 
foothold  in  the  3D  microstructure  reconstruction  and  modeling  domains  and  is  poised  to  become 
a  driving  force  in  the  materials  community  by  offering  quality  data  analysis  and  models  at  a 
tremendous  low  cost  to  the  user.  Establishing  this  early  adopter  user  base  by  influential 
researchers  in  the  field  is  an  important  result  of  this  work.  Their  recommendations  concerning 
which  computational  tools  to  use  reverberate  through  the  industry  and  help  to  establish 
DREAM3D  as  a  viable  research  and  development  platform  for  many  in  the  materials  science 
community. 

5.1  Accelerating  Research  in  3D  Materials  Science 

By  offering  a  free  to  use,  quality  software  package  for  the  reconstruction  and  analysis  of  3D 
materials  data  DREAM3D  can  accelerate  research  in  those  areas  typically  slowed  down  by 
custom  software  solutions.  For  example  in  the  past  when  a  researcher  was  given  a  3D  EBSD 
data  set  they  would  have  to  manipulate  the  files  there  were  given  into  more  efficient  data 
structures  through  custom  written  software.  Writing  and  debugging  this  software  can  steal  time 
away  from  the  actual  research  that  needs  to  be  performed.  By  using  DREAM3D  for  these  basic 
reconstructions  and  manipulations  the  research  can  quickly  transform  the  data  set  into  something 
immediately  useful  within  minutes  instead  of  having  to  wait  months  for  a  custom  and  often  non- 
robust  software  tool  to  be  written.  This  compression  of  time  will  in  effect  accelerate  their 
research  as  they  now  have  more  time  available  for  the  actual  research  instead  of  writing  file 
parsers,  alignment  routines  and  segmentation  routines.  Table  2  details  a  small  portion  of  the 
known  users  of  DREAM3D  from  around  the  world. 


Table  2.  Current  Users  of  DREAM3D 


Air  Force  Research  Laboratory 

Army  Research  Laboratory 

Carnegie  Mellon  University 

Purdue  University 

Los  Alamos  National  Lab 

Lawrence  Livermore  National  Lab 

Naval  Research  Labs 

Argonnc  National  Lab 

GE  Global  Research 

Sandia  National  Lab 

Universite  de  Lorraine.  Metz  France 

University  of  California,  Santa  Barbara 

Idaho  National  Lab 

University  of  Manchester 

NASA 

Cornell  University 

University  of  Michigan 

King  Abdulla  University  of  Technology 

In  addition  to  the  wide  range  of  users  worldw  ide  the  internet  home  page  for  DREAM3D 
averages  about  600  unique  visitors  per  month  and  the  software  has  been  downloaded  more  than 
2000  times. 
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5.2  Presentations  and  Workshops 

The  following  is  a  list  of  presentations  and  workshops  that  the  contractor  has  directly  been 
involved  in  creating  and  presenting  on  the  DR  HAM  3D  software. 

2010  MRSEC  Workshop  on  3D  Materials  Science,  Carnegie  Mellon  University.  Pittsburg  Pa 

201 1  MRSEC  Workshop  on  3D  Materials  Science,  Carnegie  Mellon  University.  Pittsburg  Pa 

2013  MRSEC  Workshop  on  3D  Materials  Science.  Carnegie  Mellon  University.  Pittsburg  Pa 

201 1  I  MS  Annual  Meeting.  San  Diego  Ca.  Using  DREA.M3D 

2012  lrst  Annual  TMS  Conference  on  3D  Materials  Science 

2013  TMS  Annual  Meeting.  San  Antonio  Tx.  Overview  of  DREAM3D’s  capabilities 
2013  2  Day  DREAM3D  workshop  for  AFRL  participants 


12 

Approved  for  public  release  (PA);  distribution  unlimited. 


6.0  RECOMMENDATIONS 


While  DREAM3D  has  a  solid  core  of  algorithms  to  deal  with  digital  microstructures,  that  initial 
data  will  most  likely  have  come  from  an  FBSD  data  source  or  data  source  that  generates 
orientation  angle  data  types.  Materials  scientists  often  utilize  other  data  modalities  such  as  direct 
optical  imaging  of  the  microstructure  where  the  "data”  is  actually  a  picture  or  image.  This  image 
data  is  usually  stored  in  some  industry  standard  format  such  as  Tif  or  PNG.  Currently 
DRF.AM3D  does  not  have  the  processing  algorithms  to  handle  this  image  data  well  and  the 
developers  are  looking  into  the  most  efficient  way  to  be  able  to  process  this  type  of  data.  One 
possible  solution  would  be  to  introduce  another  library  that  does  the  image  processing  already 
and  simply  have  DRFAM3D  act  as  a  data  staging  level  and  then  pass  the  image  data  to  this  new 
library.  Ideally  the  library  would  be  open-source  with  a  compatible  open-source  license.  There 
are  a  number  of  candidates  that  were  investigated  late  in  the  development  of  DREAM3D  which 
were  the  "Image  Processing  Poolkit”  (ITK)  and  the  "Open  Computer  Vision”  (OpenCV) 
software  library.  Both  have  a  large  number  of  image  processing  routines  that  could  be  made 
available  to  DREAM3D  users. 

Another  issue  that  needs  to  be  addressed  is  the  long-term  maintenance  of  DREAM3D.  The 
source  codes  are  all  open-source  but  a  more  suitable  neutral  hosting  location  needs  to  be  found 
so  that  any  organization  can  download  the  codes  if  they  wish  to  use  or  expand  them.  Having  this 
truly  open-source  location  where  anyone  can  get  the  sources  without  first  having  to  go  through 
the  current  developers  for  access  should  help  further  accelerate  the  development  and  usage  of 
DRFAM3D.  The  current  developers  also  receive  help  requests  and  feature  requests  through  the 
DREAM3D  web  site  which  will  need  to  transition  to  a  more  crowd  friendly  solution  such  as  a 
public  mailing  list  or  group  forum  hosted  on  the  Internet.  All  of  these  items  add  to  the  maturity 
and  user  base  of  DREAM3D  ensure  its  continued  development  and  success. 
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APPENDIX  A:  DREAM3D  USER  MANUAL 


Overview  of  the  User  Interface 

As  shown  in  Figure  A-l  DREAM3D  has  4  main  areas  of  its  user  interface 

1  The  Filter  Library 

2  The  Filter  List 

3  The  Errors  Tab 


4.  The  Pipeline  Area 


4  Filter  Library 
A  Generic 

4  io 

4  l  mage  Import 
4  Processing 
4  Reconstruction 
4  Sampling 
4  Statistics 
4  SurfaceMeshing 
4  SyntheticBuilding 
Prebuilt  Pipelines 
»'  Ebsd  30  Reconstruc 
V  Statistics 

**  Synthetic(Single  Pha.. 

Synthetlc(Primary  ♦ 
Favorite  Pipelines 


Filter  Name 


Error  Descriptor 


DREAM  30 

Search 

4  Add  Sad  Data 

4  Add  Orientation  Noise 
4  Align  Sections  (Feature  Centroid) 

4  Align  Sections  (Feature) 

4  Align  Sections  (List) 

4  Align  Sections  (Misorlentation) 

4  Align  Sections  (Mutual  Information) 
4  Avtzo  RectlimwCoordinate  Writer 
4  Avlzo  Untform^Bordinate  Writer 
4  Change  Resolution 
4  Clear  Data 
4  Convert  Euler  Angles 
4  Convert  Hexagonal  Grid  Data  to  Squ; 
4  Convert  Nodes  &  Triangles  To  STL  FI 
4  Convert  Nodes  &  Triangles  To  Vtk 
4  Create  Cell  Array  From  Field  Array 
4  Crop  Volume 
4  Delete  Arrays 


Error  Code 


Co 


Figure  A-l.  Four  Main  Areas  of  DREAM3D  User  Interface 


The  Filter  Library 

This  area  of  the  user  interface  is  broken  into  3  basic  groups  Filter  Library  Prebuilt 
Pipelines  and  Favorite  Pipelines  The  Filter  Library  section  contains  the  various  groups 
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that  the  filters  are  organized  into.  The  user  can  click  a  specific  group  and  just  the  filters 
associated  with  that  group  will  be  displayed  in  the  Filter  List  area  of  the  user  interface 

Prebuilt  Pipelines 

DREAM3D  provides  several  Prebuilt  Pipelines  that  can  aid  the  new  user  in  getting  started 
with  DRF.AM3D  Simply  double  clicking  a  preset  will  clear  any  current  filters  in  the  pipeline 
area  and  populate  the  pipeline  area  with  the  filters  from  the  Pipeline  Preset 

Favorite  Pipelines 

After  the  user  builds  a  pipeline  that  they  may  want  to  save  for  later  the  user  can  use  the 
Pipeline  menu  and  select  the  “Add  Favorite '  menu  to  save  that  specific  pipeline  configuration 
If  at  a  future  point  in  time  the  user  wants  to  remove  the  favorite  from  the  Favorites  list  they 
user  can  select  from  the  “Add  Favorite”  menu  and  choose  'Remove  Favorite*  to  remove  it  from 
the  list. 


Pipeline 

Add  Favorite 

wzm 

Remove  Favorite  OS€F 
Clear 


Figure  A-2.  Pipeline  Menu 


Filter  List 

This  section  lists  the  filters  that  are  associated  with  a  specific  group  that  is  selected  in  the  Filter 
Library  area  If  the  Filter  Library _  is  itself  selected  then  all  filters  will  be  shown  in  this  list. 
The  user  typically  will  select  a  filter  from  this  list  and  drag  it  over  to  the  pipeline  area 

Errors  &  Warnings  Tab 

This  area  displays  any  errors  and/or  warnings  associated  with  the  filter  if  it  is  actively  being  used 
in  a  pipeline  The  display  of  the  errors  can  be  toggled  on  and  off  by  pressing  the  appropriate 
buttons  Also  clicking  the  “?”  icon  will  display  all  of  the  help  (including  filter  reference, 
tutorials  and  user  manual)  in  the  users  default  web  browser 

Creating  a  Pipeline 

In  DREAM3D  the  user  processes  their  data  by  creating  what  is  known  as  a  Pipeline  which  is 
constructed  out  of  a  series  of  _Fi  Iters  _  By  chaining  together  a  series  of  filters  the  data  is 
processed  in  quick  succession  and  can  ultimately  be  saved  to  a  number  of  different  file  formats 
The  user  should  be  aware  that  all  processing  on  the  data  is  done  in  place,  i.e.,  there  is  only  a 
single  copy  of  the  data  resident  in  memory  at  any  one  time. 

Building  a  Pineline 

In  order  the  build  a  pipeline  the  user  can  either  double  click  on  a  particular  filter  or  drag  the  filter 
from  the  Filter  List  into  the  Pipelitte  Area 
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Figure  A-3.  Finpty  Pipeline  Area 


The  user  can  place  multiple  filters  into  the  pipeline  to  generate  a  workflow  of  data  input,  analysis 
and  data  output  filters  The  user  can  reorder  the  filters  by  simply  using  drag-and-drop  of  a 
selected  filter  in  the  pipeline  and  moving  it  into  a  new  position  in  the  pipeline  As  filters  are 
placed  into  the  pipeline  a  basic  error  checking  algorithm  called  the  Preflight  is  executed  on  the 
entire  pipeline  During  the  preflight  stage  the  pipeline  will  have  each  filter  check  its  input 
parameters  and  the  availability  of  required  data  arrays  Figure  A-4  shows  a  pipeline  readv  to 
execute  with  no  errors 
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Figure  A-4.  Correctly  Populated  Pipeline 
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Figure  A-5.  Selected  Filter  in  the  Pipeline  &  How  to  Remove  the  Filter 
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To  remove  a  filter  from  the  pipeline  the  user  can  simply  use  the  mouse  to  click  the  small  “X” 
(Figure  A-5)  icon  in  the  upper  left  comer  of  the  filter 


If  the  preflight  did  not  complete  successfully  the  user  will  see  the  offending  filters  show  a  red 
outline  and  red  title  area  This  indicates  that  one  or  more  of  the  input  parameters  have  an  error  or 
the  filter  requires  data  that  will  not  be  available  at  that  point  in  the  pipeline  By  looking  at  the 
error  table  the  user  can  read  the  error  message  from  the  pipeline  and  act  accordingly  An 
example  pipeline  with  errors  is  shown  in  Figure  A-6. 
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Figure  A-6.  Errors  in  the  Constructed  Pipeline 


Once  the  errors  are  resolved  the  user  can  now  execute  the  pipeline  and  generate  the  outputs 
Because  the  DREAM3D  native  file  format  stores  the  complete  state  of  the  data  arrays  the  user 
can  use  this  idea  to  add  checkpoints  to  the  pipeline  in  the  case  of  a  long  running  pipeline 
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Filter  Name 


Error  Description 


Error  Code 


Show  Help 


Toggle  The  Errors/Warnings  Area 
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Figure  A-7.  Errors  &  Warnings  Area 


Pipeline  Area 

This  area  is  where  the  user  will  construct  their  pipeline  by  either  double  clicking  on  a  filter  in  the 
filter  list  area  or  dragging  a  filter  from  the  filter  list  and  dropping  the  filter  into  the  pipeline  area 
Filters  in  this  section  can  be  rearranged  by  simply  dragging  the  filter  into  a  new  location  As  the 
user  updates  the  pipeline  a  process  called  the  Preflight  will  be  executed  to  make  sure  that  the 
pipeline  will  have  all  the  necessary  data  available  during  the  actual  execution  of  the  processing 
pipeline 
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Figure  A-8.  Pipeline  Area  Populated  with  Filters 


Import,  Export  &  Favorite  Pipelines 

DREAM3D  has  the  feature  that  will  allow  the  user  to  save  their  pipelines  to  an  external  text  file 
on  the  file  system  of  the  computer  they  are  currently  using  This  facilitates  easy  exchange  of 
pipelines  between  collaborators 
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Saving  and  Loading  a  Predefined  Pipeline 

DREAM3D  allows  the  user  to  Export  and  Import  pipelines  via  the  File  menu  and  the  Save 
Pipeline  and  Open  Pipeline  menu  items  The  pipeline  files  are  saved  in  the  ini  file  format 
popular  among  many  other  programs  This  file  format  is  a  simple  text  file  with  delineated 
sections  with  Key::  Value  entries  This  makes  the  sharing  of  Pipelines  mostly  transparent 
between  users.  If  a  pipeline  has  filters  that  require  files  to  be  read  from  or  w  ritten  to  and  the 
pipeline  file  is  passed  to  another  user  that  does  not  have  those  same  paths  then  the  new  user  may 
have  to  make  the  adjustments  inside  of  DREAM3D  after  the  pipeline  is  loaded 


File 


Open  Pipeline  8€0 
Save  Pipeline  8€S 

Recent  Files  ^  ► 

fc  4 

Figure  A-9.  File  Menu 

The  following  is  a  partial  listing  of  a  3D  EBSD  reconstruction  pipeline  saved  as  a  pipeline  file: 
[PipelineBuilder] 

Number_Filters=15 

[0] 

Filter  Name=ReadH5Ebsd 

lnputFile=/Lisers/Shared/Data/  Ang _ Data/Small  IN  100  Output/SmallINlOO  hSebsd 

ZStartlndex=l 

ZEndlnde\=l  17 

UseTransformations=false 

Array  Selections  VoxelCell\size=4 

Array  Selections  VoxelCellM \V  ox  elCell^Confidence  Index 

Array  Selections  VoxelCell\2\VoxelCell=EulerAngles 

Array  Selections  VoxelCellV3\Vox  elCel  I =Image  Quality 

Array  Selections  Vox elCell\4\VoxelCell=Phases 

ArraySelections  VoxelField\size=0 

Array  Selections  Voxel  Ensemble\size=2 

Array  Selections_VoxelEnsemble\  I \VoxelEnsemble=Crystal  Structures 
ArraySelections  VoxelEnsemble\2\VoxelEnsemble=MaterialName 
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Array-Selections  Surface \1eshPoint\size=0 
Array  Selections  SurfaceMeshFace\size=0 
Array  Selections_Surface\1eshEdge\size=0 
Array  Selections  SolidMeshPoint\size-0 
Array-Selections  SolidMeshFace\size=0 
Array  Selections  SolidMeshEnsemble\size-0 

Ml 

Filter  Name=MultiThresholdCells 
OutputArrayName=Good  Voxels 
Comparison  lnputs\size=2 
C  oniparison  Inputs)  l \ArravName=  Image  Quality 
Comparison  Inputs)  I  \CompOperator=  I 
Comparisonlnputs\l\CompValue- 1 20 
Comparison lnputsV2\Array Name- Confidence  Index 
Comparison lnputs\2\CompOperator“  I 
Comparisonlnputs\2\CompValue--0  1 0000000 1 400 1  16 

\2] 

Filter  Name=  Identify  Sample 


Filter_Name=AlignSectionsFeatureCentroid 
UseReferenceSlice  true 
ReferenceSI  ice-0 


Creating  a  Favorite  Pipeline 

If  the  user  creates  a  pipeline  that  they  intend  to  use  several  times  then  they  may  want  to  sav  e  the 
pipeline  to  the  luvorih's  area  Using  the  Pipeline  menu  and  selecting  the  Add  Favorite  can 
accomplish  adding  the  current  pipeline  to  the  Favorites  list  If  the  user  wants  to  remove  a 
fav  orite  at  any  time  they  simply  need  to  select  the  Remov  e  Favorite  menu  item 
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Pipeline 

Add  Favorite  K  XF 

_ _ _ I _ _ 


Remove  Favorite  OXF 
Clear 

Figure  A-10.  Pipeline  Menu 


Clearing  the  Pipeline 

As  a  convenience  for  those  situations  where  the  user  has  created  a  large  pipeline  and  they  would 
like  to  delete  every  filter  from  the  pipeline  the  Pipeline  Menu  also  has  a  menu  item  to  remove 
every  filter  from  a  pipeline  and  an  associated  keyboard  short  cut. 


Native  DREAM3D  File  Format 
HDF5 

DREAM3D  uses  the  [HDF5](http://www  hdfgroup  org)  as  its  native  file  format  HDF5  stores 
data  in  a  hierarchical  format  with  complete  descriptors  for  the  data  stored  in  the  file.  HDF5  is 
open-source  and  a  number  of  tools  exist  that  allow  a  user  to  view  and  manipulate  HDF5  data 
files.  Once  such  tool  is  the  free  HDFView  (http  //www  hdfgroup  org/hdf-java- 
html/hdfview/index  html#download_hdfview  )  from  “The  HDF  Group'  which  is  a  java-based 
program  that  can  view  and  edit  HDF5  data  files 

Each  array  is  stored  as  an  individual  data  set  in  FIDF5  under  one  of  several  different  types  of 
DaiaC'ontainer  storage  groups 

•  Voxel  DataContainer 

•  SurfaceMesh  DataContainer 

•  SolidMesh  DataContainer 

Depending  on  the  type  of  data  created  the  actual  data  array  that  a  user  may  be  interested  in  may 
be  stored  in  various  subgroups  in  the  HDF5  file  For  example  with  a  Voxel  Data  Container  there 
are  three  types  of  Data  Cell,  Field  and  Ensemble  Arrays  created  for  each  type  are  stored  in 
subgroups  For  example  with  Voxel  based  data  the  following  HDF5  group  organization  is  used: 

•  VoxelDataContainer  (  Group  ) 

-  DIMENSIONS  (  Dataset  ) 

ORIGIN  (  Dataset  ) 

SPACING  (  Dataset  ) 

CELL  DATA  ( _Group_  ) 

■  Grainlds(  Dataset  ) 

■  EulerAngles  (  Dataset  ) 

■  IPFColors  (  Dataset_  ) 

-  FIELD  DATA  (  Group^ ) 

■  Phases  (  Dataset  ) 
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■  AvgEuler.Angle  (  Dataset  ) 

-  ENSEMBLE  DATA  (  Group  ) 

•  C'rysialStructures  (  Dataset  ) 

•  MaterialName  (  Dataset  ) 

In  the  above  example  we  have  shown  a  number  of  data  arrays  for  each  group  type  The  user 
should  note  that  the  data  sets  shown  in  the  above  example  are  hypothetical  and  may  or  may  not 
appear  in  data  sets  that  the  user  generates 

•  SurfaceMeshDataContainer  (  Group  ) 

Faces  (  _Dataset_  ) 

Vertices  (  Dataset  ) 

CELL  DATA  (  Group  ) 

•  Normals  (  Dataset  ) 

■  Centroids  (  Dataset  ) 

■  Curvature  (  Dataset  ) 

■  IPFColoi  (  Dataset  ) 

POINT  DATA  (  Group  ) 

•  VertexNormal  (  Dataset  ) 

In  the  above  we  show  how  a  surface  mesh  is  stored  internally  in  the  nativ  e  DREAM3D  data  file 

NOTE:  DREAV13D  is  perfectly  capable  of  storing  both  the  voxel  data  and  the  surface  mesh 
data  in  the  same  file  if  the  user  so  desires  This  allows  all  the  data  to  stay  together  and  more 
easily  shared  among  collaborators 
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Appendix  B:  H5EBSD  Data  File  Specification 


Introduction 


The  EBSD  Data  from  multiple  vendors  is  stored  in  a  data  file  using  the  HDF5  file  format  library 
While  the  general  layout  of  the  HDF5  file  is  the  same  betw  een  vendors  there  are  details  that  are 
NOT  the  same  between  vendors  because  each  vendors  chooses  to  save  different  types  of  data. 
The  top-level  datasets  that  deal  with  the  basic  volume  information  is  the  same  for  every  file 


Orientations.  Reference  Frames  and  Coordinate  Systems 


DREAM3D’s  origin  follows  the  sample  coordinate  system  so  that  the  physical  location  of  the  0 
row  and  0  column  voxel  should  visually  appear  in  the  lower  left  comer  of  a  computer  graphics 
display  Sample  Coordinate  System  (White)  overlaid  with  EBSD  Coordinate  System  (Yellow) 


Figure  B-l.  TSL  Coordinate  System 


Commercial  EBSD  acquisition  systems  do  not  ty  pically  follow  this  convention  and  DREAM3D 
needs  input  from  the  user  so  that  the  proper  transformations  to  the  data  can  be  applied  during  the 
Reconstruction  and  other  analysis  Commercial  EBSD  software  packages  allow  for  some  initial 
transformations  of  the  data  in  which  case  the  DREAM3Denvironment  does  not  have  any  way  of 
determining  if  those  transformations  have  already  occurred  During  the  import  process  the  user 
is  asked  a  few  questions  regarding  the  orientation  of  their  EBSD  data  in  relation  to  the  sample 
coordinate  system  Currently  there  are  3  items  that  must  be  answered  otherwise  undefined 
behavior  may  occur  during  any  of  the  analysis  algorithms 

•  Some  Commercial  EBSD  acquisition  systems  allow  for  a  scan  rotation,  which  rotates 
the  sample  coordinate  system.  180  degrees  around  the  Z-axis 

•  Should  we  rotate  the  Euler  angles  to  bring  them  in  line  with  the  sample  reference  frame9 
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HDF5  File  Layout 

Table  B-l.  H5EBSD  Root  Node  Specification 


H5Ebsd  Specification 

Root  Level  Datasets  and  Group 

Attribute  Name  "FileVersion" 
Current  Value=“4" 

Name 

HDF5  Type 

Value 

Index 

H5T_NATIVE  INT32 

List  of  all  Slice  index  v  alues 

EulcrT  ransfomiation  Angle 

H5T  NATIVE  FLOAT 

EulerTransfomiation  Angle 

H5T  NATIVE  FLOAT 

Manufacturer 

H5T  STRING 

The  Manufacturer 

currently  is  either  TSL  or 

HKL 

Max  X  Points 

H5T  NATIVE  INT64 

The  maximum  number  of  X 
points  in  the  sample  grid 

Max  Y  Points 

H5T  NATIVE  INT64 

The  maximum  number  of  Y 
points  in  the  sample  grid 

SampleTransformation  Angle 

H5T  NATIVE  FLOAT 

SamplcTransformation  Angle 

H5T  NATIVE  FLOAT 

Stacking  Order 

H5TN  ATIV  E_U  INT3  2 

Defines  which  slice 
corresponds  to  the  Z=0  in 
the  coordinate  system 

Optional  Attribute  of  type 

H5T  STRING,  with  Name 
"Name"  and  Value  ("  Low 

To  High"  or  “High  To 

Low”) 

X  Resolution 

H5T_NATIVE  FLOAT 

Resolution  between  sample 
points  in  the  X  direction 

Y  Resolution 

H5TNATIVEFLOAT 

Resolution  between  sample 
points  in  the  Y  direction 

Z  Resolution 

H5T  NATIVE  FLOAT 

Resolution  between  slices  in 
the  Z  Di  rection 

ZEndlndex 

H5T  NATIVE  INT64 

Starting  Slice  index 

Z  Start  Inde  x 

H5T  NATIVE  INT64 

Ending  Slice  index 
(inclusive) 

Slice  Data  organized  by  Slice  index 
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Slice  Group  Specification 

Each  Slice  is  grouped  into  its  own  H5G  GROUP  with  the  Name  of  the  group  simply  the  index 
of  the  slice.  Within  each  slice  group  are  2  more  groups  with  names  Data  and  Header. 


Table  B-2.  Slice  Group  Specification 


Name 

HDF^  T\  pc 

Value 

Data 

H5G  GROUP 

Contains  all  the  data  columns 

Header 

H5G  GROUP 

Contains  all  the  header  entries 

TSL  Specification 

This  section  details  the  data  to  be  imported  from  a  ang  file  into  the  h5ebsd  file 


Table  B-3.  TSL  Data  Group  Specification 


Name 

HDFs  1\pc 

Value 

Phil 

H5TNATIVEFLOAT 

Contains  all  the  Phil  data  in  a  1 D  Array  with 
length  equal  to  the  total  number  of  points 

Phi 

H5T  NATIVE  FLOAT 

Contains  all  the  Phi  data  in  a  ID  Array  with 
length  equal  to  the  total  number  of  points 

Phi2 

H5TNATIVEFLOAT 

Contains  all  the  Phi2  data  in  a  1 D  Array  w  ith 
length  equal  to  the  total  number  of  points 

X  Position 

H5T  NATIVE  FLOAT 

Contains  all  the  X  position  data  in  a  ID  Array 
with  length  equal  to  the  total  number  of 
points 

Y  Position 

H5T  NATIVE  FLOAT 

Contains  all  the  Y  position  data  in  a  1 D  Array 
with  length  equal  to  the  total  number  of 
points 

Image  Quality 

H5T  NATIVE  FLOAT 

Contains  all  the  Image  Quality  data  in  a  ID 
Array  with  length  equal  to  the  total  number  of 
points 

Confidence  Index 

H5T  NATIVE  FLOAT 

Contains  all  the  Confidence  Index  data  in  a 

1 D  Array  with  length  equal  to  the  total 
number  of  points 

Phase  Data 

H5T  NATIVE  INT32 

Contains  all  the  PhaseData  data  in  a  1 D  Array 
with  length  equal  to  the  total  number  of 
points 

SEM  Signal 

H5T  NATIVE  FLOAT 

Contains  all  the  SEM  Signal  data  in  a  1 D 

Array  with  length  equal  to  the  total  number  of 
points 

Fit 

H5T  NATIVE  FLOAT 

Contains  all  the  Fit  of  Solution  data  in  a  ID 
Array  with  length  equal  to  the  total  number  of 
points 
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Table  B-4.  TSL  Header  Group  Specification 


Name 

HDF5  l\|x 

Value 

OnginalFilc 

H5T  STRING 

Path  to  the  ang  file  that  was  imported 

Original  Header 

H5T  STRING 

Contains  the  original  header  from  the  imported 
ctf  file 

TEM  PIXpcrUM 

H5T_NATrV'E  FLOAT 

Contains  value  for  the  header  entry 

TEM  PIXperUM 

x-star 

H5T_N ATI VE  FLOAT 

Contains  value  for  the  header  entry  x-star 

y-star 

H5T_NATIVE  FLOAT 

Contains  value  for  the  header  entry  y-star 

z-star 

H5T  NATIVE  FLOAT 

Contains  \alue  for  the  header  entry  z-star 

WorkingDistancc 

H5T  NATIVE  FLOAT 

Contains  \  alue  for  the  header  entry 
WorkingDistancc 

ElasticConstants 

H5T  STRING 

Contains  value  for  the  header  entry 
ElasticConstants 

GRID 

H5T  STRING 

Contains  \  alue  for  the  header  entry  GRID 

XSTEP 

H5T  NATIVE  FLOAT 

Contains  \alue  for  the  header  entry  XSTEP 

YSTEP 

H5T  NATIVE  FLOAT 

Contains  \alue  for  the  header  entry  YSTEP 

NCOLSODD 

H5T_NAT1VE  INT32 

Contains  value  for  the  header  entry 
NCOLSODD 

NCOLS  EVEN 

H5T  NAT1VE  INT32 

Contains  value  for  the  header  entry 

NCOLS  EVEN 

NROWS 

H5T  NATIVE  INT32 

Contains  \alue  for  the  header  entry  NROWS 

OPERATOR 

H5T  STRING 

Contains  value  for  the  header  entry 

OPERATOR 

SAMPLEID 

H5TSTRING 

Contains  value  for  the  header  entry' 

SAMPLEID 

SC  AN  ID 

H5T  STRING 

Contains  value  for  the  header  entry  SC  ANID 

Phases 

H5G  GROUP 

Group  that  contains  a  subgroup  for  each  phase 
where  the  name  of  each  subgroup  is  simply  the 
index  of  the  phase  starting  at  1 
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Table  B-5.  TSL  Phase  Group  Specification 


Name 

HDF5  Ivpe 

Value 

Categories 

H5T  NATIVE  INT32 

Formula 

H5T  STRING 

Info 

H5T  STRING 

LatticcConstants 

H5TJNATIVE  FLOAT 

LatticeConstants 

H5T  STRING 

NumberFamilies 

H5TNATIVEINT32 

Phase 

H5T  NATIVE  INT32 

Symmetry 

H5TNATIVEINT32 

hkIFamilics 

H5G  GROUP 

Contains  all  the  HKL  Family  information 
where  the  number  of  datasets  contained  in  this 
group  is  the  number  of  HKL  Families 

Table  B-6.  TSL  HKL  Family  Group  Specification 


Name 

111)1  '  f  \  pe 

Value 

{ Based  on  Index  of  the  family  }  If  there  arc  4 

families  then  there  are  4  data  sets  with  names  "O  '. 

Custom  Sec  Below 

"T.  "T  and  “3“. 

TSL  HKL  C  Structure  for  Reading  Binary  HKL  Family 

typedef  struct 

{ 

int  h,@n 
int  k,@n 
int  l,@n 
int  sl;@n 

float  dififractionlntensity,@n 
int  s2,@n 
}  HKLFamilyt, 

HKL  Specification 

This  section  details  the  data  to  be  imported  from  a  ctf  file  into  the  h5ebsd  file 
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Table  B-7.  HKL  (.ctf)  Data  Group  Specification 


Name 

1 11)1  '  Type 

Value 

Phase 

H5T  NATIVE  INT32 

X 

H5T  NATIVE  FLOAT 

Y 

H5TNATIVEFLOAT 

Z 

H5TNATIVEFLOAT 

Note  that  this  ONLY  appears  in  a 
“3D”  ctf  data  file 

Bands 

H5T_NATIVE_rNT32 

Error 

H5T  NATIVE  INT32 

Euler  1 

H5T_NAT1VE  FLOAT 

In  2D  files  these  are  in  Degrees  In  3D 
files  these  are  in  Radians 

Eulcr2 

H5T_NATIVE_FLOAT 

In  2D  files  these  are  in  Degrees  In  3D 
files  these  are  in  Radians 

Euler3 

H5T_NATIVE  FLOAT 

In  2D  files  these  are  in  Degrees  In  3D 
files  these  arc  in  Radians 

MAD 

H5T  NATIVE  FLOAT 

BD 

H5T  NATIVE  INT32 

BS 

H5T_NATIVE_INT32 

Grainlndcx 

H5T  NATIVE  INT32 

GrainRandomC'oiourR 

H5T  NATIVE  UINT8 

GrainRandomColourG 

H5T  NATIVE  UINT8 

GrainRandomColourB 

H5T  NATIVE  UINT8 
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Table  B-8.  HKL  (.ctf)  Header  Group  Specification 


Name 

HDF5  T  v  pc 

Value 

OnginalFilc 

H5T  STRING 

Path  to  the  ctf  file  that  was  imported 

Original  Header 

H5T  STRING 

Contains  the  original  header  from  the  imported  ctf 
file 

Pq 

H5T  STRING 

Contains  value  for  the  header  entry  Pi] 

Author 

H5TSTRING 

Contains  value  for  the  header  entry  Author 

Job  Mode 

H5T  STRING 

Contains  value  for  the  header  entry  JobMode 

XCells 

H5T  NATIVE  INT32 

Contains  value  for  the  header  entry  XCells 

YCells 

H5T  NATIVE  INT32 

Contains  v  alue  for  the  header  entry  YCells 

XStep 

H5T  N ATI VE  FLOAT 

Contains  value  for  the  header  entry  XStep 

YStcp 

H5T  NATIVE  FLOAT 

Contains  value  for  the  header  entry  YStcp 

ZStcp 

H5T  NATIVE  FLOAT 

Contains  value  for  the  header  entry  ZStcp 

ZCells 

H5T_NAT1VE  FLOAT 

Contains  value  for  the  header  entry  ZCells 

AcqEl 

H5TNAT1VEFLOAT 

Contains  value  for  the  header  entry  AcqEl 

AcqE2 

H5T_NATIVE  FLOAT 

Contains  value  for  the  header  entry  AcqE2 

AcqE3 

H5T  NATIVE  FLOAT 

Contains  value  for  the  header  entry  AcqE3 

Mag 

H5T  NAT1VE  INT32 

Contains  value  for  the  header  entry  Mag 

Coverage 

H5T  NATIVE  INT32 

Contains  value  for  the  header  entry  Coverage 

Device 

H5T  NATIVE  INT32 

Contains  value  for  the  header  entry  Dev  ice 

KV 

H5T  NAT1VE  INT32 

Contains  value  for  the  header  entry  KV 

TiltAnglc 

H5T  NATIVE  FLOAT 

Contains  value  for  the  header  entry  TiltAnglc 

TiltAxis 

H5TNATIVEFLOAT 

Contains  value  for  the  header  entry'  TiltAxis 

Phases 

H5G  GROUP 

Group  that  contains  a  subgroup  for  each  phase 
where  the  name  of  each  subgroup  is  simplv  the 
index  of  the  phase  starting  at  1 
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Table  B-9.  HKL  (.ctf)  Phase  Group  Specification 


Name 

HDF5  Type 

Value 

Comment 

H5T  STRING 

Contains  value  for  the  header  entry  Comment 

Internal  1 

H5T  STRING 

Contains  value  for  the  header  entry  Internal  1 

lntemal2 

H5T  STRING 

Contains  value  for  the  header  entry  lntemal2 

Lattice  Angles 

H5T  NATIVE  FLOAT 

Contains  value  for  the  header  entry  Lattice  Angles 
in  a  1x3  array 

LatticcDimensions 

H5TNATIVEFLOAT 

Contains  v  alue  for  the  header  entry  Lattice 
Dimensions  in  a  1x3  array 

LaucGroup 

H5T_NATIVE_INT32 

Contains  v  alue  for  the  header  entry  LaueGroup 
plus  an  H5T  STRING  Attribute  which  is  the  string 
name  of  the  Laue  Group  for  example  'Hexagonal- 
High  6/m  mm" 

SpaccGroup 

H5TNATIVE  1NT32 

Contains  value  for  the  header  entry  SpaceGroup 

PhaseNamc 

H5T  STRING 

Contains  value  for  the  header  entry  PhascName 

Stacking  Order  Discussion 

The  Stacking  Order  refers  to  the  order  in  which  the  z  slices  are  stacked  together  when  they  are 
read  from  the  file.  The  enumerations  are  also  in  the  EbsJI.ibConstants.h  header  file. 

As  a  further  explanation  if  the  ordering  is  Low  To  High  then  the  slice  with  the  lowest  number  is 
positioned  at  Z=0  in  3D  Cartesian  space.  For  example  if  your  data  set  is  numbered  from  23  to  86 
with  file  names  of  the  form  Slice  023. ang  and  you  select  “Low  To  High  '  then  the  data  inside  of 
file  Slice  023. ang  will  be  positioned  at  Z=0  during  any  method  that  has  to  deal  with  the  data. 

The  opposite  of  this  is  if  the  user  were  to  select  to  have  their  data  High  to  Low  in  which  case  the 
file  with  name  Slice_086  ang  will  be  positioned  at  Z=0  and  the  file  with  name  "Slice  023. ang” 
will  be  positioned  at  Z=64. 
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APPENDIX  (  :  STATSG  EN  E  RAT  OR  APPLICATION 

In  order  to  allow  the  user  to  quickly  generate  a  set  of  statistics  that  can  be  used  to  create  a 
synthetic  microstructure  the  "StatsGenerator"  program  was  created  Using  this  program  the  user 
can  generate  the  necessarv  statistics  that  describe  a  microstructure  and  save  those  statistics  to  a 
DRHAMvl)  Hie  that  can  then  be  used  in  a  DREAM3D  pipeline  to  generate  a  synthetic 
microstructure 

The  main  features  are 

•  Describe  the  grain  size  distribution  v  ia  a  simple  Gaussian  distribution 

•  Select  from  several  preset  microstructure  types 

•  Define  the  Omega  3  Distributions 

•  Define  the  Shape  distributions 

•  Define  the  Neighbor  distributions 

•  Define  a  Cry  stallographic  Texture  through  ODF  parameters 

•  Define  the  MDF  through  various  parameters 

•  Define  the  Axis  ODF  for  the  grains 

•  Add  as  many  phases  as  the  user  needs 

•  Define  each  phase  according  to  sev  eral  presets 

Primary 

Precipitate 

Transformation 

Matrix 

Boundary 

Size  Distribution  Tab 

Mu:  This  is  the  av  erage  value  of  the  lognormal  grain  size  distribution 

Sigma:  This  is  the  standard  deviation  of  the  lognormal  grain  size  distribution 

Sigma  Cut  Off  Value:  This  allows  the  user  to  truncate  the  distribution  to  remove  very  large 
grains 

Bin  Step  Size:  This  is  the  size  of  bin  to  use  in  segregating  the  grains  into  size  classes  for 
correlating  other  statistics  to  grain  size  Note  that  the  Bins  to  be  Created  is  displayed  in  the 
bottom  left  comer 

Preset  Statistic  Models:  This  allow  s  the  user  to  select  a  iiior/>h(>/of!iciil-t\/)c  of  microstructure 
to  populate  the  default  data 

Default  this  populates  the  statistic  tabs  with  generic  random  data  that  may  not  create  a 
buildable  microstructure  This  option  should  only  be  used  if  the  user  is  going  to  enter  the  v  alues 
on  all  the  statistics  tabs  themselves 

Equiaxed  this  populates  the  statistic  tabs  with  data  that  is  designed  to  generate  a  random 
equiaxed  microstructure 
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Figure  C-l.  StatsGenerator  Main  Window 


Rolled  this  populates  the  statistic  tabs  with  data  that  is  designed  to  generate  a  rolled 
microstructure  with  elongated  grains  with  user  defined  aspect  ratios. 

Aspect  Ratio  1  this  is  the  aspect  ratio  between  the  dimensions  of  the  grains  in  the  rolling 
direction  and  transverse  direction,  respectively 

Aspect  Ratio  2:  this  is  the  aspect  ratio  between  the  dimensions  of  the  grains  in  the  rolling 
direction  and  normal  direction,  respectively  This  value  must  be  larger  than  Aspect  Ratio  1  or 
the  default  values  will  be  wrong 

Phase  Properties:  This  is  the  area  where  the  user  can  enter  information  about  the  phase  for 
which  statistics  are  currently  being  generated  The  Plus  Button  allows  the  user  to  add  a  phase, 
the  Minus  Button  allows  the  user  to  remove  a  phase  and  the  Wheel  Button  allows  the  user  to  edit 
the  currently  selected  phase 

Select  Cry  stal  Structure  this  allows  the  user  to  specify  the  crystal  structure  of  the  phase 
Currently,  the  two  options  are  Cubic  and  Hexagonal 

Fraction  this  is  the  volume  fraction  of  the  phase  The  Calculated  Phase  Fraction  is  updated  as 
more  phases  are  added,  by  scaling  the  current  total  of  all  the  phases  fractions  to  1  (in  case  the 
user’s  total  is  not  equal  to  1  when  finished) 
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Select  Phase  Type  this  specifies  the  type  of  the  phase  Currently,  the  two  types  of  phases  are 
Primary  and  Precipitate  Note  that  there  must  be  at  least  one  Primary  phase  before  any 
Precipitate  phase  can  be  created  or  the  Synthetic  Builder  will  fail 

Fraction  of  Precipitate  on  Boundary  if  the  phase  type  is  set  to  Precipitate,  then  the  user  must 
specify  the  number  fraction  of  the  precipitates  that  are  located  on  grain  boundaries  of  the  primary 
phase  This  value  will  be  scaled  to  1  if  the  user’s  value  is  larger  than  1  The  value  is  keyed  to  -1 
for  Primary  phases 

W  n _ Hum  Properties _ 

Select  Crystal  Structure  Hexagonal 
Fraction 

Calculated  Phase  Fraction  0.0 

Select  Phase  Type  Primary  T] 

Fraction  of  Precipitate  on  Boundary 

Cancel  OK 

Figure  C-2.  Phase  Properties 


Create  Data:  This  locks  in  the  values  the  user  has  entered  and  populates  the  other  tabs  with 
default  values  The  user  can  move  through  the  other  tabs  and  change  any  default  values  if 
desired 

Omega3  Tab 

Bin  this  column  is  calculated  from  the  size  distribution  and  cannot  be  changed 

Alpha  this  is  the  alpha  parameter  of  a  Beta  distribution  Omega  3  is  normalized  and  can  only 
be  between  0  and  1 ,  so  the  Beta  distribution  is  a  good  fit 

Beta  this  is  the  beta  parameter  of  the  Beta  distribution 

Color  this  allows  the  user  to  change  colors  of  the  curves  for  image  creation  or  easier 
identification  during  stats  generation 

Shape  Distribution  Tab 

Bin  this  column  is  calculated  from  the  size  distribution  and  cannot  be  changed 

Alpha  this  is  the  alpha  parameter  of  a  Beta  distribution  B/A,  C/A  and  C/B  are  normalized  and 
can  only  be  between  0  and  1,  so  the  Beta  distribution  is  a  good  fit. 

Beta  this  is  the  beta  parameter  of  the  Beta  distribution 

Color  this  allows  the  user  to  change  colors  of  the  curves  for  image  creation  or  easier 
identification  during  stats  generation 
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Neighbor  Distribution  Tab 

•  Bin  this  column  is  calculated  from  the  size  distribution  and  cannot  be  changed 

•  Alpha  this  is  the  alpha  parameter  of  a  Power  Law  distribution 

this  is  the  exponent  of  a  Power  Law  Distribution 

•  Beta  this  is  the  beta  parameter  of  a  Power  Law  distribution 

•  Color  this  allows  the  user  to  change  colors  of  the  curves  for  image  creation  or  easier 
identification  during  stats  generation 

ODF  Tab 

W  eights  and  Spreads  Sub-Tab 

•  Euler  1-3:  these  are  the  Euler  angles  that  define  an  orientation  that  the  user  would  like  to 
increase  in  weight 

•  Weight:  this  is  the  weight  in  \1RD  (multiples  of  random) 

•  Sigma:  this  is  the  spread  to  use  in  blurring  out  the  orientation  chosen  The  value 
corresponds  to  the  number  of  bins  in  Rodrigues  (orientation)  space  it  takes  for  the  MRD 
value  entered  in  the  Weight  column  to  reduce  to  0  0  (decreasing  quadratically  from  the 
bin  of  the  entered  orientation) 

•  Calculate  ODF:  this  builds  the  ODF  and  then  creates  pole  figures  (PFs)  for  the  user  to 
inspect 

Pole  Figure  (PF)  Sub-Tabs 

There  are  three  PFs  formed  for  each  of  the  crystal  structures  that  can  be  chosen  (though  they  are 
of  different  directions  for  the  different  crystal  structures) 

MDF  Sub  Tab  This  sub-tab  will  display  the  baseline  MDF  for  the  generated  ODF  The 
implemented  algorithm  proceeds  by  randomly  sampling  pairs  of  orientations  from  the  ODF  and 
calculating  the  misorientation  (axis-angle  only)  Only  the  angle  is  plotted  in  the  misorientation 
distribution  plot  The  user  can  also  add  axis-angle  pairs  to  increase  in  weight 

•  Angle  :  this  is  the  angle  of  the  misorientation  to  increase  in  weight 

•  Axis:  this  is  the  axis  of  the  misorientation  to  increase  in  weight  If  the  crystal  structure 
being  used  for  the  phase  is  Hexagonal,  then  this  axis  is  in  the  3-index,  orthogonal 
convention,  not  the  true  (hkil)  convention 

•  W  eight:  this  is  the  weight  in  units  of  MRD  (multiples  of  random )  of  the  entered 
misorientation 

Axis  ODF  Tab 

Weights  and  Spreads  Sub-Tab 

•  Euler  1-3:  these  are  the  Filler  angles  that  define  an  orientation  that  the  user  would  like  to 
increase  in  weight 

•  W  eight:  this  is  the  weight  in  MRD  (multiples  of  random )  to  be  assigned  to  the 
orientation  listed 

•  Sigma:  this  is  the  spread  to  use  in  blurring  out  the  orientation  chosen  The  value 
corresponds  to  the  number  of  bins  in  Rodrigues  (orientation)  space  it  takes  for  the  MRD 
value  entered  in  the  Weight  column  to  reduce  to  0  0  (decreasing  quadratically  from  the 
bin  of  the  entered  orientation) 
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•  Calculate  ODF:  this  builds  the  ODF  and  then  creates  pole  figures  (PFs)  for  the  user  to 
inspect 

Pole  Figure  (PF)  Sub-Tabs 

There  are  three  pole  figures  formed,  which  correspond  to  the  location  of  the  3  principal  axes  of 
the  grains  to  be  generated  (i.e  a  >  b  >  c). 

3JIF  C 


Figure  C-3.  Omega  3  GUI 
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Figure  C-4.  Shape  Distribution  Function  GUI 
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Figure  C-S.  Neighbor  Distribution  Function  GUI 
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Figure  C-6.  ODF  GUI 
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Figure  C-7.  MDF  GUI 
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Figure  C-8.  Axis  ODF  GUI 
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LIST  OF  SYMBOLS,  ABBREVIATIONS,  AND  ACRONYMS 


Acronym 

Description 

AFRL 

Air  Force  Research  Laboratory 

BSE 

BackScatter  Electron  Image 

DOD 

Department  of  Defense 

DREAM3D 

Digital  Representation  Environment  for  Analysis  of  Microstructure 

DTIC 

Defense  Technical  Information  Center 

EAR 

Export  Administration  Regulation 

EBSD 

Electron  BackScatter  Diffraction 

EDS 

Energy  Dispersive  X-ray  Diffraction 

FEM 

Finite  Element  Methods 

GUI 

Graphical  User  Interface 

HPC 

High  Performance  Computing 

use 

Ion  Induced  Secondary  Electron 

ICME 

Integrated  Computational  Materials  Science 

ITK 

Image  Processing  Toolkit 

ITAR 

International  Traffic  in  Arms  Regulation 

MDF 

Misorientation  Distribution  Function 

ODF 

Orientation  Distribution  Function 

OpenCV 

Open  Computer  Vision 

PF 

Pole  Figure 

RTF 

Rich  Text  Format 

RX 

Materials  and  Manufacturing  Directorate 

SEI 

Secondary  Electron  Image 

SNR 

Signal  to  Noise  Ratio 

SSH 

Secure  Shell 

TBB 

Thread  Building  Blocks 

USAF 

United  States  Air  Force 

WPAFB 

Wright-Patterson  Air  Force  Base 
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